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Abstract 

In this response, we try to give a repair to our previous proof given 
in Appendix of [9] by using orthogonal projection. Moreover, we answer 
the question raised in [16]: If a centered Gaussian process Gt admits 
two series expansions on different Riesz bases, we may possibly study the 
asymptotic behavior of one eigenvalue sequence from the knowledge on 
the asymptotic behaviors of another. 

1 The Backgrounds 

Many thanks to the note of Prof. Zantcn [16], a flaw was found to lie in Appendix 
of Li, et al. [9], which tries to give another proof for the asympotitics of the 
eigenvalues for Karhunen-Loeve expansion of fBm process. Fortunately, all the 
theorems in the mainbody of [9] still holds, due to the nice proof of [7]- [8]. In 
the rest of this response, we will try to fix our uncompleted proof in [9] and 
answer a related question raised in [16]. 

Let us briefly recall some backgrounds of our discussions. Suppose B = 
{Bt, t > 0} is a standard fBm process within a finite time interval [0, 1] (can be 
scaled to [0,r], but it does not matter our proof) and with Hurst exponent H 
{0<H < 1). 

The autocorrelation function of Bt can be written as [1] 

Rbi-s, t)^E [B,Bt] = i [s^" + t^" -\s- t\'") (1) 
According to Mercer's theorem [2]- [3], we have 

oo 

i?6(.s,i) = ^A„0„(.s)</)„(t) (2) 

n=l 

1 

Rb{s,t)(t)n{t)dt = Xn(f>n{s) (3) 
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where {4>n{t)}'^=i is a set of orthonormal functions in the interval [0, 1], where 
A„ are the corresponding eigenvalues of the nth orthonormal functions. 

As shown in [4]- [9], Eq.(3) is the continuous Karhunen-Loeve (K-L) expan- 
sion for fBm process and A„ is the associated eigenvalues. Our main problem 
here is to discuss the asympotics of A„ . 



2 Prof. Bronski's Proof 

In [7]-[8], Prof. Bronski had showed that A„ ~ as follows. 

Clearly, from Eq.(2)-(3), we get a integral kernel [T^^] (x) = /g Rb{x, y)(j){y)dy 
on i2([0, 1] X [0, 1]). Moreover, this operator is a non-negative symmetric, 
Hilbert-Schmidt and compact. 

We can then prove the rigorous estimates of the eigenvalues by considering 
the Nystrom approximation of this kernel [10]-[12] on a special orthonormal 
basis 0„(x) = {-s/S sin((n -I- ^)7ra;)5^Q}. Particularly in [7]-[8], the operator 
is approximated by an operator A from the sequence space I2 to ^2, which has 
matrix elements 

An.rn ^ {(l>n{x)A(l)r,i{y)) ^ 2 1 j Rb{x , y) sm{{n + l-)Trx) sm{{m + l-)Trx)dxdy 

Jo Jo ^ ^ 

(4) 

We can also consider x"^ Ay with the kernel matrix A„,„i as a n-degenerate 
approximation of the Mercer kernel function Rii(x,y). 

By examining the leading order diagonal piece D and the higher order off- 
diagonal piece OD oi A {A = D + OD), Bronski proved that ODn „i has higher 
order and can be neglected with respect to Dn^m- Thus, the eigenvalues of A is 
mainly determined by D. 

In [7]- [8], Bronski further proved that 

sin(^g)r(2g + l) , ^ ^ ^ sin(7rg)r(2g+l) , 

^^^^^ + eieft < MA) < ^^^^^ + er^ght (5) 

where eieft and Sright are neglectablc items. 
Thus, we reach the conclusion we desired 

A„(T,) « KiA) ~ (6) 



3 Another Proof that Actually Detours 
3.1 The Proof in Appendix of [9] 

In [9] , we consider the series expansion of the fBm process on a set of orthonor- 
mal basis functions (t) 

oo 

Bt = Y,('n(t>n{t) (7) 
n=l 
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where c„ is the corresponding coefficient satisfying 

E{cnC,n} = \iS[n - m] (8) 

If we can obtain the representation of c„, we can directly get A„ via Eq.(5). 

However, in [9] (or equivalcntly http://arxiv.org/abs/0805.3002vl), we 
instead study another series expansion of the fBm process on a set of special 
basis functions tpn{t) proposed in [13]- [15] 

oo 

Bt = ^bnMt) (9) 

n=l 

where {'0n(i)}^i is a set of linearly independent but not orthogonal basis func- 
tions. Thus, the expansion coefficients 6„ is not equivalent to the eigenvalues of 
the Karhuncn-Loeve expansion. 

The Appendix of [9] proves the E{bn} ^ n~^^^^. But as shown in [16], it 
is just a intermediate result for our final goal. 



3.2 A Remedy 

Because the problem lies in the orthogonality, we will give a remedy for our 
proof by orthogonal projection. 

More precisely, we wiU project these functions {'0ra(i)})^Li to a set of or- 
thonormal basis functions {4>n{t)}^^i as 

oo 

Mt)^^P^n,kMt) (10) 
k=l 

where fi„^k = WO}^^(^t)i'^k{t)) = ( Jq K{t)'>Pk{t)dt 
Based on Eq.(7), (9)-(10), we have 

oo oo oo / oo \ 

St = ^ Cn(j)n{x) = ^ b,ii'n{x) = X! X! ) 't'n{x) (11) 

n=l n=l n=l \k=l I 

Thus, we can study the eigenvalue asymptotics of c„ from 

oo 

C„ = ^ Mn.fcfo/c (12) 
fc=l 

This method is similar to what had been applied in [17]-[18]. We will discuss 
when such projection is valid at the end of this response. 

The success of Prof. Bronski [7]- [8] inspired us to choose the orthonormal 
basis functions 0„(t) = {■\/2sin((n -I- 5)7ri)^g}. Because the Karhunen-Loeve 
expansion for brownian motion _ff = i is well known [19], [13], we will focus on 
the cases that H 
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As pointed out in [9]- [15], we can expand a standard fBm process Bt as 



sm(xnt) , 1 - cos(?/„i) 

; 1- Wn 



(13) 



where a;„ are the positive zeros of the Bessel function J-h of the first kind, y„ 
are the positive zeros of the Bessel function Ji-h of the first kind. As shown in 
[9], we have 



Xn=mT + hi+0{n ^), yn = rnr + h2 + 0{n ^) 



(14) 



where hi and are constants. 

z„ and Wn are independent sequences of independent, centered Gaussian 
random variables on a common probability space, with 



E [z„] = E [wn] = 



E [zl] 



2c 



H 



2cl 



(15) 
(16) 



where = m±2M££). 

Let us first examine the projection of C^'"^^"*-* }^]^. Given n, fc € N, we can 
obtain the projection coefficients ijLn,k as 

An,fe 

— ^-^V2sin([n - -\Kt)di 
^fc 2 

sin(xfe - [n - ^Jtt) sin(2:fc + [n - i]7r) 



V2 

2.Tfc 

\/2di / {xk + [ti - ^Itt) + {xk - [rt - i]7r) 



0(?7r 



2^/2(^l \/2(ii 



Xk 



0{n- 



(17) 



where di is a constant. 

As shown in [9], wc have 

Ji_ff (.Tfc) = d2xl^^'^ + 0(a;^^^^) 

where c?2 is a postiche constant. 

Thus, based on Eq.(14) and (18), we have 



(18) 



k=l 
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y + 0{n-^) 



-2H+1 



^3 y — 2 + o("-') 



(19) 



where is a positive constant. 
It is easy to show that 



^ : ^> ' 



k—7i 

(20) 



and 



2_f/+l oo -2H+1 

y ^ 2 < ^3 y 2 + 0{n-') = d4n-2«-i + 0(n-3^ 

^ r^2 _ r„ „ ii2^2r ^ r/o;. 1^^l2 



fc=i Ffc- 2I 



^ [(2fc-l)n]- 



(21) 



where ds and (i4 are positive constants. 



-2H + 1 



Noticing that J2kLi TT~T — 119 21^ converges, based on (13)-(15), we have 
y E [zl] f^l, = d,n-'"-' + Oin-') ^ n"^^"^ (22) 



fc=i 

where d^ is a positive constant. 



Similarly, we can prove that the projection coefficients of ^^y^^^j^i 
satisfies 

00 

yE[u^l]i,l,^n-^"-^ (23) 
fe=i 

where fL„^k = \l ^-^2£lliilly2 sin([ri - }^'Kt)dt. 

Due to the independence of zy. and w^, we have 

00 

A„ = £; \cl\ =y{E [zl] fil, + E [wl] A^,fc) ~ n-2«-i (24) 

fe=i 

Therefore, our proof in [9] is repaired. 

In summary, the nice proof given by Bronski in [7]- [8] is a direct attack on 
the problem, and our proof detours. However, the appendix in [9] phis this 
response gives another view on the asympotics of K-L expansion of fBm process 
and meanwhile shows how the important results obtained in [7]- [8] and [13]- [15] 
can be linked together. 
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4 Some Discussions 



Finally, wc would like to discuss the interesting question raised in [16]: // a 
centered Gaussian process Gt admits two different series expansions, under what 
conditions do the two eigenvalue sequences have the same asymptotic behavior? 

We think this question ean be partly solved by evaluating the mapping op- 
erator T between the two sets of basis functions. If the mapping T consists of 
appropriate projection coefficients, the asymptotics of the eigenvalues can still 
be held. 

The general cases are obviously too difficult to solve in this short response. 
In the follows, we will briefly discuss a special case: when one basis is a Riesz 
basis and the other is a orthonormal basis. 

Suppose we have a expansion of the integral kernel K is in L2([0,l] x 
[0,1]) on a Riesz basis {V'n(0}n^i (^lo need to be orthogonal) as K{s,t) = 
^^-^ r'0„(s)?/'„(t); and meanwhile we have the K-L expansion of i^T on a or- 
thonormal basis {<f)n{t)}^=i in the same space as K{s,t) = J2'^=i ^4'n{s)4>n{t) ■ 

Based on the property of Riesz basis [20]- [23], we can always find a linear 
bounded bijective operator T satisfying {'0n(i)}J^i = {T4'n{t)}'^^i- 

The basis function used in [13]-[15] can be viewed as a special Riesz basis, 
which satisfying the above requirement. Thus, we can study the asymptotics of 
K-L eigenvalues by using orthogonal projection. 

Since {V'nCOIn^i is a Riesz basis, it will associate with a set of Riesz se- 
quence. Hence, if A is the infinite matrix representing this bounded linear 
operator T, the sequence {^fe.njfc^i formed by the nih column of ^ is a Bessel 
sequence in P. 

Assume that A„ and t„ have the same asymptotics. According to [24]- [29], 
the upper bound for the decaying rate of the eigenvalues for a smooth Mercer 
kernel is 0{n''^). Thus, we have A„,t„ ^ p> 1. 

Since {Ak,n}T=i is a Bessel sequence, YlkLi ^k,n'^k < Ci Y.'kLi '^k = G2 
when r„ ^ , Ci and C2 are constants. Thus, X^fc^i ^fe n'''^ converges. Based 
on the mapping relation, we have 

00 

Xn = Y.<nrk (25) 

fe=l 

or equivalently 

00 

d6n-J' = ^A2„A:-f + 0(n-^') (26) 
fc=i 

which indicates that given a n € N, the maximum value of Ak^n in terms of k 
locates at a point k* that is approximately proportional to n (say, k* = \_d'^n\). 
Here dg and d^ are two positive constants. 

Similarly, if {V'n(i)}r!^i {4>n{t)}^=i are two different Riesz bases, we 
can always find two linear bounded bijective operators U and V satisfying 
{U'ilj„{t)}'^^i = {V^(/>Ti(i)}^i- Thus, if Gt admits two series expansions on 
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different Riesz bases, we may possibly study the asymptotic behavior on one 
basis from the knowledge on the asymptotic behaviors of another. 

Besides, when 7? — )■ 0, the decaying rate of the eigenvalues will approach the 
bound A„ - 0{n-^) as A„ n-^^^-i. This can be another example in practice 
supporting Weyl's conclusion: the rate 0(n~^) for the eigenvalues of a smooth 
Mercer-like kernel cannot be improved in general [24]- [29]. 
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